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I  Introduction 

In  previous  studies  (Samejlma,  RR-80-4,  RR-81-2) ,  three 
subtests  of  the  original  Old  Test,  i.e.,  Subtests  1,  2  and  3,  have 
each  been  used  as  the  Old  Test,  in  place  of  the  original  one,  in 
the  estimation  of  the  item  characteristic  functions  of  ten  unknown, 
binary  test  items.  The  main  features  of  these  studies  are:  1)  the 
number  of  test  items  in  each  Old  Test  is  much  less  than  that  of  the 
original  Old  Test  and,  as  the  result,  the  amount  of  test  Information 
is  less  than  that  of  the  original  Old  Test  for  any  fixed  value  of 
ability  0  ;  2)  the  test  information  function  of  each  Old  Test  is 
not  constant  for  the  Interval  of  6  of  our  interest,  making  it 
necessary  to  transform  ability  6  to  its  strictly  increasing  function 
T  ,  for  which  our  Old  Test  has  a  constant  test  Information  function; 
and  3)  in  so  doing,  the  method  of  moments  for  fitting  polynomials , 
which  also  is  the  least  squares  solution  (Samejlma  and  Livingston, 
RR-79-2) ,  is  effectively  used. 

In  these  studies,  the  combination  of  the  Simple  Sum  Procedure 
of  the  Conditional  P.D.F.  Approach  and  the  Normal  Approach  Method  was 
consistently  used.  Our  calibration  data  are  based  upon  the  five 
hundred  hypothetical  examinees  whose  ability  levels  are  one  hundred 
equally  spaced  positions  starting  from  -2.475  and  ending  with  2.475  , 
with  five  examinees  sharing  each  position.  The  results  turned  out  to 
be  quite  successful. 

In  the  present  study,  we  shall  investigate  the  possibility  of 
further  reducing  the  number  of  test  items  in  the  Old  Test.  In  other 
words,  we  shall  find  out  how  robust  our  methods  can  be  over  the 
reduction  in  the  amount  of  test  information  of  the  Old  Test.  Throughout 
the  present  study,  we  shall  use  the  same  combination  of  a  method  and 
an  approach  and  the  same  group  of  hypothetical  examinees  as  in  the 
previous  studies. 
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II  Sii.  Subtests  of  the  Original  Old  Teat 

Let  g  denote  an  Item  of  the  original  Old  Teat,  and  x^ 

(■0,1,..., m  )  be  the  graded  item  score  of  item  g  .  The  operating 
8 

characteristic  of  vhe  graded  item  score  x  la  denoted  by  ?  (9)  , 

and  follows  the  normal  ogive  model  such  that  * 


(2.2)  Px  (0)  -  (2tr) 

g 


-1/2 


r*g(e-bx  > 

8 

J  «> 
g 


72  du 


where  a  (>0)  is  the  item  discrimination  parameter,  and  b  is 

®  Xg 

the  item  response  difficulty  parameter  which  satisfies 


(2.2)  -  *  b0  <  h  <  »2  <  . <  >>.  <  b  -  -  . 

g  g 

With  our  original  Old  Teat,  m  -  2  for  each  item.  Table  2-1  presents 

© 

the  item  discrimination  parameter,  a  ,  and  the  two  item  response 

8 

difficulty  parameters,  bj^  and  b2  ,  for  each  of  the  thirty-five  test 
items. 

There  are  six  subtests  of  the  original  Old  Teat,  each  of  which 
we  used  as  the  Old  Test  in  the  present  study.  They  are  called  Subtests 
4,  5,  6,  7,  8  and  9,  respectively.  The  numbers  of  teat  Items  Included 
by  these  six  subtests  are  15,  15,  11,  9,  7  and  5,  respectively.  These 
test  items  are  marked  with  crosses  in  Table  2-1,  indicating  which  item 
belongs  to  each  subtest.  We  notice  that  Subtest  4  is  a  subtest  of 
Subtest  2,  as  well  as  of  the  original  Old  Test,  just  as  Subtest  3  is  a 
subtest  of  Subcest  1  (Samejlma,  RR-80-4,  RR-81-2). 

The  Importance  of  the  square  root  of  the  test  information  function, 
1(0)  ,  of  the  Old  Test  In  the  estimation  of  the  operating  characteristics 
of  the  discrete  item  responses  has  previously  been  demonstrated 
(Samejima,  RR-80-2 ,  RR-80-4,  RR-81-2).  Among  other  reasons,  it  has 
an  important  role  in  transforming  ability  0  to  t  ,  when  it  is  not 


TABLE  2-1 


Item  Discrimination  Parameter, 


Parameters, 


ter,  a  ,  and  Item  Response  Difficulty 
S 

x  -  1  and  x_  ■  2  ,  for  Each  of  the 
£  R 


Thirty-five  Test  Items  of  the  Original  Old  Test.  Items 
Included  by  Subtests  4,  5,  6,  7,  8  and  9  Are  Marked 
By  Crosses,  Respectively. 


Subteat  4 

Subtut  S 

Subttst  6 

Subtest  7 

Subtest  S 

Subtest  9 

i.e 

-4.75 

i 

-3.75 

1.9 

-4.50 

-3.50 

2.0 

-4.25 

-3.25 

1.5 

-4.00 

-3.00 

1.6 

-3.75 

-2.75 

1.4 

-3.50 

-2.50 

1.9 

-3.00 

-2.00 

1.8 

-3.00 

-2.00 

1.6 

-2.75 

-1.75 

2.0 

-2.50 

-1.50 

1.5 

-2.25 

-1.25 

1.7 

-2.00 

-1.00 

1.3 

-1.75 

-0.75 

1.4 

-1.50 

-0.50 

2.0 

-1.25 

-0.25 

1.6 

-1.00 

0.00 

1.8 

-0.75 

0.25 

1.7 

-0.50 

0.50 

1.9 

-0.25 

0.75 

1.7 

0.00 

1.00 

1.5 

0.25 

1.25 

1.8 

0.50 

1.50 

1.4 

0.75 

1.75 

1.9 

1.00 

2.00 

2.0 

1.25 

2.25 

1.6 

1.50 

2.50 

1.7 

1.75 

2.75 

1.4 

2.00 

3.00 

1.9 

2.25 

3.25 

1.6 

2.50 

3.50 

1.5 

2.75 

3.75 

1.7 

3.00 

4.00 

1.8 

3.25 

4.25 

2.0 

3.50 

4.50 

1.4 

3.75 

4.75 

A~ 
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constant  for  the  Interval  of  6  of  our  interest.  Figure  2-1  presents 
the  square  root  of  the  teat  information  function  of  each  of  the  six 
subtests  by  solid  curves. 

Polynomials  of  degree  3,  A,  5,  6  and  7  were  fitted  to  the  square 
root  of  the  test  information  of  each  subtest  by  the  method  of  moments. 

®  k 

These  polynomials,  E  a  9  (m«3,A,5,6,7)f  which  were  obtained  by 

k-0  k 

using  the  Interval  of  9  ,  [-A.0,  A.O]  ,  are  plotted  in  Figure  2-1  by 

dots,  for  each  of  the  six  subtests.  Out  of  these  five  polynomials  for 
each  subtest,  that  of  degree  7  was  selected  as  the  approximation  to  the 
square  root  of  the  test  Information  function  and  used  in  the  process  of 
the  transformation  of  9  to  t  .  Table  2-2  presents  the  coefficients 
a.K  (k-0, 1,2, 3, A, 5, 6 ,7)  of  this  polynomial  and,  in  Appendix  as  Table 
A-l,  va  find  those  for  the  other  four  polynomials,  for  each  subtest. 

It  has  buen  pointed  out  (Samejlma  and  Livingston,  RR-79-2)  that  the 
selection  of  an  appropriate  interval  of  6  is  very  important  in  fitting 
a  polynomial  for  a  specific  function.  From  Figure  2-1,  we  can  see  that 
for  each  subtest  the  polynomial  of  degree  7  fits  well  to  the  square  root 
of  the  test  information  function.  We  also  experimented  with  the 
interval,  [-3.0,  3.0]  ,  for  Subtest  A,  and  the  results  turned  out  to 
be  less  than  satisfactory.  These  results  are  shown  in  Appendix,  as 
Figure  A-l,  and  their  coefficients  are  presented  in  Table  A-2. 

It  has  been  shown  (Samejlma,  RR-80-2)  that  the  transformation  of 

ability  9  to  t  ,  which  provides  us  with  a  constant  amount  of  test 

2 

Information,  I*(t)  -  C  ,  for  our  Old  Test,  can  be  obtained  as  another 
polynomial  of  degree  m+1  ,  such  that 

urt-1  , 

(2.3)  t  -  E  a*  9k  , 

k-0 


where 


m*))”*  in mi* 


10 


qoLUmO. 

-4.0  -10  -10 


,„|  |  |, 
•10  00  10  to  10 
UTOtr  TOUT  t 


■L 

40 


LATBfT  TfUfT  0 


lATBfr  TOUT  § 


OO 


*40  >10  -tO  -10  00  id 
UTCNT  TOUT 


tjO  10 


JL 

40 


LATENT  TRAIT  8 


flOURt  /-I 


Square  Root  of  the  Test  Information  Function,  [1(6) l1^2  (Solid  Curved 

ofwH£iheHslx  s;?te-;vnd  lts  *  a 

Cutve),  Which  was  Fitted  by  the  Method  of  Moments  with  [-4.0,  4.0]  as 

the  Interval  of  9  .  The  Degrees  of  the  Five  Polynomials  are  3,  4,  5  6 

and  7,  Respectively. 


vtfMIXl 


vtMNX]  biftftXl 


UTMT  TRAIT  9  LATWT  TRAIT  • 


LATENT  TRAIT  •  LATWT  TRAIT  • 


LATENT  TRAIT  0 


FIGURE  2-1  (Continued) 


Subtest  7,  Degree  3 


Subtest  7,  Degree  4 


ao  -ao  -to  -to  ao  io  20  30  40 

LATENT  TRAIT  • 

-4.0  -ao  -20  -10  OO  10  20  30  40 
LATENT  TRAIT  0 

1  Subtest  7,  Degree  5 

aol 

1  Subtest  7,  Degree  6 

ao  .ao  -ao  -to  00  10  20  ao  40 

LATENT  TRAIT  0 

1 

-4.0  -ao  -20  -to  00  IO  20  ao  40 
LATENT  TRAIT  0 

SjO 

V 

Subtest  7,  Degree  7 

4.0  -ao  -ZO  -10  QO  IjO  2.0  ao  4.0 
LATENT  TRAIT  B 


FIGURE  2-1  (Continued) 
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TABLE  2-2 


Coefficients  of  the  Polynomial  of  Degree  7  Obtained  Ly  the  Method  of 
Moments  Using  the  Interval  of  6  ,  (-4.0,  4.0),  to  Approximate  the 
Square  Root  of  the  Test  Information  Function  for  Each  of  the  Six 

Subtexts. 


“k 

k 

Subtest  4 

Subtest  5 

Subtest  6 

0 

0.206537411*01 

0,330289851*01 

0.282440811*01 

1 

0. 304184781*00 

0.230056881*00 

-0. 3886564 5D-01 

2 

0.833595971*00 

0. 680382 74D-02 

-0.89251467D-01 

3 

-Q.99045455D-01 

-0.101584741*00 

0.31726461D-01 

4 

-0.103456401*00 

-0.45492312D-02 

0.14561530D-01 

5 

0.10055738D-01 

0.11649033D-01 

-0.41758069D-02 

6 

0, 31140746D-02 

-0.17744225D-03 

-0 . 86600132D-03 

7 

-0. 31461009D-03 

-0.38798596D-03 

0.14748755D-03 

°k 

1 t 

Subtest  7 

- - - 

Subtest  8 

Subtest  9 

0 

0.236988381*01 

0.207945331*01 

0.180314751*01 

l 

0.200905681*00 

0.44 51568 6D-01 

0.17911119D+00 

2 

-0.67057488D-01 

-0.13624656D+00 

-0.17773403D-01 

3 

-0.89954850D-01 

-0.38893432D-01 

-0.28202923D-01 

4 

0.14720463D-01 

0.28958024D-01 

0.46765970D-02 

5 

0.10798462D-01 

0.43578763D-02 

0.15433890D-02 

6 

-0.85028384D-03 

-0.14683524D-02 

-0.40858826D-03 

7 

-0.37494191D-03 

-0.13598905D-03 

-0.27032925D-04 

-12- 


II-3 


for  k  ■  0 

for  k  ■  1,2, ..... ,m,m+l  , 


where  d  Is  an  arbitrarily  set  constant  for  adjusting  the  origin  of 
x  .  For  our  purpose,  we  used  C  ■  3.5  ,  and  d  -  0  .  Table  2-3 
presents  the  resultant  nine  coefficients,  a*  (k*0, 1,2, 3, 4, 5, 6, 7, 8)  , 
for  each  of  the  six  subtests.  Figure  2-2  presents  the  functional 
relationship  between  8  and  t  ,  for  each  subtest.  As  is  expected 
from  the  square  root  of  the  test  information  function  of  each  subtest, 
which  is  shown  in  Figure  2-1,  the  transformation  of  6  to  t  is  close 
to  linear,  except  for  Subtest  4.  The  interval  of  t  corresponding  to 
the  interval  of  8  ,  [-4.0,  4.0]  ,  is  [-3.36106,  3.57935]  for 

Subtest  4,  [-3.39905,  3.46366]  for  Subtest  5,  [-2.93479,  2.97885] 

for  Subtest  6,  [-2.54949,  2.63541]  for  Subtest  7,  [-2.33633,  2.18084] 

for  Subtest  8  and  [-1.82137,  2.08427]  for  Subtest  9  .  We  notice  that, 
as  the  number  of  test  items  decreases,  the  interval  of  t  is  shortened. 
This  comes  from  the  fact  that  the  square  root  of  the  test  information 
decreases  as  the  number  of  test  items  decreases,  and  yet  we  used  the 
same  constant,  C  ■  3.5  ,  for  each  of  the  six  subtests. 

Figure  2-3  presents  the  square  root  of  the  test  information 
1/2 

function,  [I*(t)]  ,  which  was  obtained  by  the  polynomial  transformation 

of  8  to  t  ,  such  that 

(2.5)  [I*(t)]1/2  -  [I<8)31/2-^- 

-  [I(8)]1/2  C  [Z  o  eV1  , 

k-0 

by  dots,  together  with  the  horisontal  line  indicating  C  »  3.5  ,  for 
each  of  the  six  subtests.  We  can  see  in  this  figure  that  the  actual 
square  root  of  the  test  information  is  very  close  to  the  target  constant, 
for  most  subtests.  For  Subtest  4  and  Subtest  9,  however,  we  can  see  some 
noticeable  discrepancies  between  the  two. 


I 

I 

l 

r 

t 

i 

i 

i 

i 

i 

! 
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TABLE  2-3 

Coefficients  of  the  Polynomial  of  Degree  8  Transforming  0  to  x 

for  Each  of  the  Six  Subtests. 


v 

* 

“k 

IV 

Subtest  4 

Subtest  5 

Subtest  6 

O.OOOOOOOOD+OO 

O.OOOOOOOOD+OO 

O.OOOOOOOOD+OO 

0.59010689D+00 

0.94368529D+00 

0.8069 7 374D+00 

0.43454969D-01 

0. 3286S269D-01 

-0 . 55522350D-02 

0.79390092D-01 

0.64798356D-03 

-0.85001397D-02 

-0.70746754D-02 

-0. 72560529D-02 

0.22661758D-02 

-0. 5911794 3D-02 

-0.25995607D-03 

0.83208743D-03 

0.47884467D-03 

0.55471586D-03 

-0.19884795D-03 

0.127 10509D-03 

-0.72425408D-05 

-0 . 35346993D-04 

8 

-0.11236075D-04 

-0. 13856641D-04 

0.52674125D-05 

U 

* 

“k 

K 

Subtest  7 

Subtest  8 

Subtest  9 

0 

O.OOOOOOOOD+OO 

O.OOOOOOOOD+OO 

O.OOOOOOOOD+OO 

1 

0. 67710966D+00 

0.59412951D+00 

0. 51518500D+00 

2 

0.28700811D-01 

0.63593837D-02 

0.25587311D-01 

3 

-0.63864274D-02 

-0.12975863D-01 

-0.16927050D-02 

!  4 

-0.64253464D-02 

-0.27781023D-02 

-0. 2014494 5D-02 

5 

0.84116931D-03 

0.16547442D-02 

0.26723411D-03 

mm 

0.51421248D-03 

0.20751792D-03 

0. 73494714D-04 

-0.34705463D-04 

-0.59932751D-04 

-0. 16677072D-04 

HI 

-0.13390782D-04 

-0.48567518D-05 

-0.96546161D-06 

Subtest  9 


-18- 


I1I-1 


III  Approximation  of  the  Density  Function  of  t  »  Polynomial  Using 
the  Method  £f  Moments 

Aa  was  mentioned  in  Chapter  1,  in  the  present  study,  we  used  the 
same  five  hundred  hypothetical  examinees  as  we  did  in  the  previous 
studies  (Samejima,  RR-77-1,  RR-78-1,  RR-78-2,  RR-78-3,  RR-78-4,  RR-78-5, 
RR-78-6,  RR-;;0-2,  RR-80- RR-81-2).  The  maximum  likelihood  estimate, 

§  ,  for  each  examinee  s  ,  was  obtained  from  his  response  pattern  for 

5 

each  of  the  six  subtests.  Subtests  4  through  9,  using  the  basic  functions 
(cf.  Samejima,  1969,  1972).  As  1*  jmed  out,  for  Subtest  9,  two 
examinees.  No.  2  and  No.  99,  obtained  negative  and  positive  infinities 
as  their  maximum  likelihood  estimates,  respectively.  Since  there  »re 
only  two  non-flnite  estimates,  we  excluded  these  two  examinees  from  the 
total  group.  Instead  of  using  some  substitute  estimates  (cf.  Samejima, 
RR-80-3,  RR-81-1) ,  and  used  the  remaining  498  examinees  for  Subtest  9, 
whereas  for  all  the  other  five  subtests  the  original  group  of  500 
examinees  was  used. 

By  virtue  of  the  transformation-free  character  of  the  maximum 
likelihood  estimate  (Samejima,  1969),  §  thus  obtained  can  be 

transformed  to  the  other  maximum  likelihood  estimate,  t  ,  through 
the  same  polynomial  transformation  given  by  (2.3).  Using  (2.3)  and 
the  coefficients,  a£  (k«0, 1,2, 3, 4, 5, 6, 7, 8)  ,  which  are  shown  in 
Table  2-3,  we  transformed  §  to  for  the  500  examinees  for 

each  of  the  Subtests  4  through  8,  and  for  the  498  examinees  for 
Subtest  9. 

Table  3-1  presents  the  first  through  tenth  sample  moments  about 
the  origin,  and  those  about  the  midpoint,  of  the  set  of  xs  ,  which  is 
based  upon  each  of  the  six  Old  Tests,  i.e.  Subtests  4  through  9.  The 
mldpol.it  of  the  set  of  t  '  s  turned  out  to  be  0.1026  for  Subtest  4, 

S 

0.0684  for  Subtest  5,  0.1934  for  Subtest  6,  0.0426  for  Subtest  7, 

-0.2807  for  Subtest  8,  and  0.1175  for  Subtest  9.  This  midpoint  and 
the  first  p  moments  about  the  midpoint  were  used  in  applying  the  method 
of  moments  (Elderton  and  Johnson,  1969)  for  fitting  a  polynomial  of 
degree  p  ,  the  detailed  procedure  of  which  is  described  in  a  previous 
study  (Samejima,  RR-77-1).  Table  3-2  presents  the  resultant  five  sets 
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of  coefficients,  ,  of  the  polynomials  of  degrees  3  through  7  to 
approximate  the  marginal  density  function,  g(x)  ,  which  are  given  by 

P  4 

(3.1)  g(x)  -  £  w  t  2  ,  p-3,4,5,6,7  , 

j-0  J 

for  each  of  the  six  Old  Teste. 

Figure  3-1  presents  these  resultant  five  polynomials  approximating 
the  density  function,  g(f)  ,  for  each  of  our  six  Old  tests.  In  the  same 
figure,  also  presented  is  the  set  of  t  ' s  ,  in  the  form  of  a  frequency 
distribution  with  the  subinterval  width  of  0.25  .  We  can  see  in  this 
figure  that  Subtest  5  has  the  smoothest  frequency  distribution,  and, 
as  we  proceed  up  to  Subtest  9,  the  frequency  distribution  becomes  less 
smooth.  This  phenomenon  is  the  result  of  the  reduction  in  the  amount 
of  test  Information,  as  we  can  see  in  Figure  2-1  in  the  preceding  chapter. 
We  can  also  see  in  Figure  3-1  that  the  frequency  distribution  of  Subtest 
4  has  a  high  irregularity  around  t  •  0.0  ,  and  this  is  again  due  to  the 
small  amount  of  test  Information  around  6  -  0.0  ,  as  is  shown  in  Figure 
2-1. 

We  have  observed  with  Subtest  2  (Samejima,  RR-80-4)  that, 
regardless  of  the  high  irregularity  of  the  frequency  distribution  of 

f  and  the  resultant  low  degree  of  fitness  of  the  polynomial,  the 
8 

estimation  of  the  item  characteristic  functions  turned  out  to  be 
quite  successful.  For  this  reason,  without  trying  to  increase  the 
degree  of  the  polynomial  nor  using  several  polynomials  for  the 
subintervals  to  increase  the  fitness,  we  simply  adopted  the  polynomial 
of  degree  4  in  each  of  the  six  situations.  The  choice  of  the  degree 
4  over  the  others  is  based  upon  the  fact  that  in  the  previous  studies 
we  compared  the  results  obtained  by  using  the  polynomials  of  degrees  3 
and  4  ,  and  sometimes  included  the  one  obtained  by  using  the  polynomial 
of  degree  5,  and  the  resultant  estimated  item  characteristic  functions 
in  Degree  4  case  turned  out  to  be  just  as  good  as  we  could  wish  for. 

These  polynomials  of  degree  4  are  shown  as  larger  graphs  in  Figure  3-1 
for  the  six  Old  Tests. 


FIGURE  3-1  (Continued) 
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FIGURE  3-1  (Continued) 


T 


os 

OB 

04 

02 


°^AO  -00 


FIGURE  3-1  (Contiru 


8,  Degree  4 


^ _ 

2 JO  3X)  4.0 


Subtest  8,  Degree  5 


T 

Subtest  8,  Degree  7 


-28- 


IV- 1 


IV  Estimation  of  the  Item  Characteristic  Functions  of  the  Ten  Binary 
Teat  Items 

As  was  the  case  with  the  previous  studies  (Samejlma,  RR-77-1, 
RR-78-1,  RR-78-2 ,  RR-78-3,  RR-78-A,  RR-78-5,  RR-78-6,  RR-80-4,  RR-81-2) , 
ten  binary  test  items,  which  follow  the  normal  ogive  model  given  by 
(2.2)  and  whose  parameters,  a^  and  ,  are  shown  in  Table  4-1,  were 
chosen  as  unknown  test  items,  whose  item  characteristic  functions,  l.e.. 


Px  (0) 
*h 


for 


^•“h"  1 


h-1,2, 


,10  ,  are  to  be  estimated. 


We  obtained  the  estimates  of  the  conditional  expectation  and 


variance  of  t  ,  given  f  ,  which  are  given  by 


(4.1)  f(x|t)  -  t  +  C_2-£-  log  g(t) 


and 

2 

(4.2)  Var .  (t  jf)  -  C_2(l  +  C-2-^- log  $(t>] 

dt* 

1/2 

where  C  is  the  target  square  root  of  the  test  information,  ll*(t)]  ’ 

and  g(t)  is  the  polynomial  of  degree  4  obtained  by  the  method  of 
moments  as  the  estimate  of  the  density  function,  g(t)  ,  for  each  of 
the  six  sets  of  t  ’s  obtained  upon  Subtests  4  through  9  .  In  so 
doing  we  found  that  for  some  examinees  the  estimated  conditional  density, 
g(f^)  ,  assumed  negative  values,  and  they  have  to  be  excluded  from  the 
original  set  of  data.  They  number  five  for  Subtest  5,  one  for  Subtest 
6  ,  two  for  Subtest  7  ,  one  for  Subtest  8  and  six  for  Subtest  9  .  We 
also  found  that  for  some  other  examinees  the  estimated  conditional 
variance,  which  is  given  by  (4.2),  turned  out  to  be  negative  values. 

There  are  two  such  examinees  for  Subtest  S  ,  eight  for  Subtest  6  , 
seventeen  for  Subtest  7  ,  and  twelve  for  Subtest  8  .  As  the  result, 
the  total  numbers  of  hypothetical  examinees  who  are  included  in  our 
data  are:  500,  493,  491,  481,  487  and  492,  for  Subtests  4  through  9, 
respectively. 

From  the  first  two  conditional  moments  of  t  about  the  origin 
we  approximated  the  conditional  density  function,  $(x|t)  ,  of  x  ,  given 
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Item  Discrimination  Parameter,  a 

h 

and  Item  Difficulty  Parameter,  b 

h 

of  Each  of  Ten  Binary  Items. 
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f  ,  following  the  Normal  Approach  Method  of  the  Conditional  P.D.F. 
Approach.  Thus  we  have 

(4.3)  *<t|*)  -  (2irfl2r1/2  exp{-(x-J)’)2/(2p2)}  , 

where 

(4.4)  -  «(x|f) 
and 

(4.5)  f>2  -  Var . (r | f) 

We  adopted  Simple  Sum  Procedure  of  the  Conditional  P.D.F. 

Approach  to  estimate  the  item  characteristic  functions  of  the  ten 
binary  test  items,  as  we  did  for  Subtests  1,  2  and  3  (cf.  RR-80-4 , 

RR-81-2) .  Let  Py  (8)  be  the  estimated  operating  characteristic  of 

the  item  score  x^ 

(4.6)  f  (8)  -  P  I T (8) ]  -  E  ♦(t|t  )[  E  $(r|f  ))_1  , 

*h  *h  sex^  8  s-l  * 

where  ♦(T|fg)  is  the  estimated  conditional  density  obtained  by  the 
Normal  Approach  Method,  which  is  given  by  (4.3). 

Figures  4-1  through  4-6  present  the  resultant  estimated  item 
characteristic  functions  for  the  ten  binary  test  items  by  dotted  curves, 
which  are  based  upon  Subtests  4  through  9,  respectively.  In  these 
figures,  also  presented  are  the  corresponding  estimated  item  characteristic 
functions  which  were  obtained  upon  the  original  Old  Test  by  dashed  curves, 
the  theoretical  item  characteristic  functions  by  solid  curves  and  the 
frequency  ratios  of  the  correct  answer  obtained  by  using  subintervals  of  8 
with  the  width  of  0.25  by  jagged  solid  curves. 

Comparison  of  these  six  sets  of  the  estimated  item  characteristic 
functions  indicates  that,  as  the  number  of  test  items  in  the  Old  Test 
decreases,  the  accuracy  of  estimation  also  decreases.  We  can  see  in 


<"0’1 . V  of  item  h  .  We  can  write 


ITEM  CHARACTERISTIC  FUNCTION  ITEM  CHARACTERISTIC  FUNCTION 
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LATENT  TRAIT  0 


LATENT  TRAIT  0 


FIGURE  4-1 

Estimated  Item  Characteristic  Function  Based  upon  Subtest  4 
(Dotted  Curve),  Obtained  by  the  Simple  Sum  Procedure  of  the 
Conditional  P.D.F.  Approach  and  the  Normal  Approach  Method, 
for  Degree  4  Case,  in  Comparison  with  the  One  Based  upon 
the  Original  Old  Test  (Dashed  Curve),  the  Theoretical  Item 
Characteristic  Function  (Smooth  Solid  Curve)  and  the 
Frequency  Ratios  of  Those  Who  Answered  Correctly 
(Jagged  Solid  Line). 
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FIGURE  4-1  (Continued) 
Subtest  4 
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FIGURE  4-2 

Estimated  Item  Characteristic  Function  Based  upon  Subtest  5 
(Dotted  Curve),  Obtained  by  the  Simple  Sum  Procedure  of  the 
Conditional  P.D.F.  Approach  and  the  Normal  Approach  Method, 
for  Degree  4  Case,  in  Comparison  with  the  One  Based  upon 
the  Original  Old  Test  (Dashed  Curve),  the  Theoretical  Item 
Characteristic  Function  (Smooth  Solid  Curve)  and  the 
Frequency  Ratios  of  Those  Who  Answered  Correctly 
(Jagged  Solid  Line) . 
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FIGURE  4-2  (Continued) 
Subtest  5 
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FIGURE  4-2  (Continued) 
Subtest  5 
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FIGURE  4-2  (Continued) 
Subteat  5 
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FIGURE  4-3 

Estimated  Item  Characteristic  Function  Based  upon  Subtest  6 
(Dotted  Curve),  Obtained  by  the  Simple  Sum  Procedure  of  the 
Conditional  P.D.F.  Approach  and  the  Normal  Approach  Method, 
for  Degree  4  Case,  in  Comparison  with  the  One  Based  upon 
the  Original  Old  Test  (Dashed  Curve),  the  Theoretical  Item 
Characteristic  Function  (Smooth  Solid  Curve)  and  the 
Frequency  Ratios  of  Those  Who  Answered  Correctly 
(Jagged  Solid  Line) . 


FIGURE  4-3  (Continued) 
Subtest  6 
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FIGURE  4-3  (Continued) 
Subtest  6 
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LATENT  TRAIT  S 


FIGURE  4-4 

Estimated  Item  Characteristic  Function  Based  upon  Subtest  7 
(Dotted  Curve),  Obtained  by  the  Simple  Sum  Procedure  of  the 
Conditional  P.D.F,  Approach  and  the  Normal  Approach  Method, 
for  Degree  4  Case,  in  Comparison  with  the  One  Based  upon 
the  Original  Old  Test  (Dashed  Curve),  the  Theoretical  Item 
Characteristic  Function  (Smooth  Solid  Curve)  and  the 
Frequency  Ratios  of  Those  Who  Answered  Correctly 
(Jagged  Solid  Line). 
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FIGURE  4-4  (Continued) 
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FIGURE  4-4  .(Continued) 
Subtest  7 
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FIGURE  4-4  (Continued) 
Subtest  7 
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FIGURE  4-4  (Continued) 
Subtest  7 
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LATENT  TRAIT  O 


S  f^e  lte“  Characteristic  Function  Based  upon  Subtes 
conditional^  °btfined  the  SijnPle  Sum  Procedure  of 

fo?  Degree  l  Case  the  Nonnal  Approach  Meth, 

thl  (irSi  nu  J'  in  Comparison  with  the  One  Based  U1 
the  Original  Old  Test  (Dashed  Curve),  the  Theoretical  I 
haracteristic  Function  (Smooth  Solid  Curve)  and  the 
Frequency  Ratios  of  Those  Who  Answered  Corr"tly 
(Jagged  Solid  Line). 
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FIGURE  4-5  (Continued) 
Subtest  8 
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FIGURE  4-5  (Continued) 
Subtest  8 
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FIGURE  4-5  (Continued) 
Subtest  8 
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FIGURE  4-5  (Continued) 
Subtest  8 
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FIGURE  4-6 

Estimated  Item  Characteristic  Function  Baaed  upon  Subtest  9 
(Dotted  Curve),  Obtained  by  the  Simple  Sum  Procedure  of  the 
Conditional  P.D.F.  Approach  and  the  Normal  Approach  Method, 
for  Degree  4  Case,  in  Comparison  with  the  One  Based  upon 
the  Original  Old  Test  (Dashed  Curve),  the  Theoretical  Item 
Characteristic  Function  (Smooth  Solid  Curve)  and  the 
Frequency  Ratios  of  Those  Who  Answered  Correctly 
(Jagged  Solid  Line) . 
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FIGURE  4-6  (Continued) 
Subtest  9 
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FIGURE  4-6  (Continued) 
Subtest  9 
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4-6  (Continued) 
Subtest  9 
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Figure  4-1  that,  for  each  binary  test  Item,  the  estimated  Item 
characteristic  function  is  fairly  close  to  the  theoretical  item 
characteristic  function.  In  fact,  for  items  2,  4  and  8  ,  the 
approximations  are  even  better  than  those  baaed  upon  the  original 
Old  Test.  We  find,  however,  that  for  those  items  having  difficulty 
parameters  close  to  zero,  i.e.,  items  5,  6  and  7  ,  the  approximations 
are  worse.  This  is  expected  from  the  fact  that  the  square  root  of  the 
test  information  function  of  Subtest  4  assumes  low  values  around 
6  •  0.0  ,  as  we  have  seen  in  Figure  2-1  . 


V  Linear  Regressions  of  the  Maximum  Likelihood  Estimate  f  on 
Ability  t8 

Figure  5-1  presents  the  scatter  diagram  of  our  hypothetical 

examinees  with  respect  to  their  ability  levels,  t  ,  and  their  maximum 

s 

likelihood  estimates,  t  ,  for  each  of  the  six  subtests.  There  are  500 

8 

plots  in  the  first  five  graphs  for  Subtests  4  through  8,  and  498  in 
the  last  graph  for  Subtest  9  (cf.  Chapter  3).  In  each  graph  of  Figure 
5-1,  also  presented  is  a  straight  line  with  45  degrees  from  the 
abscissa,  which  indicates  the  asymptotic  unbiasedness  of  the  maximum 
likelihood  estimate.  We  can  see  in  these  graphs  that  for  such  subtests 
as  Subtests  4,  7,  8  and  9  there  are  some  isolated  clusters  resultant 
from  small  amounts  of  test  information.  In  other  words,  there  are 
subgroups  of  examinees  whose  response  patterns,  and  consequently 
maximum  likelihood  estimates,  are  identical  for  such  subtests.  This 
tendency  becomes  more  conspicuous  as  the  number  of  test  items  in  the 
Old  Test  decreases. 

Table  5-1  presents  the  coefficients  of  the  sample  linear 
regression,  of  f  on  ability  t  ,  which  is  given  by  ot  +  6  ,  for 
each  of  the  six  subtests.  This  sample  linear  regression  is  the  best 
fitted  linear  function  of  x  which  makes  the  sum  total  of  the  squared 
discrepancies  of  f  minimal.  The  values  of  a  and  $  turned  out  to 
be  very  close  to  unity  and  zero,  respectively,  for  all  the  six  subtests. 
This  is  the  reason  why  they  are  not  drawn  in  Figure  5-1,  and  if  they 
are,  they  will  be  indistinguishable  from  the  45  degree  lines. 

Close  examination  of  each  of  the  six  scatter  diagrams  of  Figure 

5-1  reveals  that  the  sample  conditional  distribution  of  f  ,  given  x  , 

is  not  too  close  to  the  normal  distribution  for  certain  ranges  of  x 

for  Subtests  4,  7,  8  and  9  .  The  error  score,  e  ,  for  each  individual 

s 

examinee  s  is  defined  by 


(5.D  ..  -  it.  -  Tsm*(xs)r1/2  . 

1/2 

Since  for  all  the  subtests  Il*(x)]  *3.5  .we  used  this  constant  In 


FIGURE  5-1 


Scatter  Diagram  of  t  Plotted  Against  t  for  Our  Hypothetical  Examinees 
Which  Is  Based  upon  Each  of  the  Six  Subtesta. 
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TABLE  5-1 

Coefficients  of  the  Sample  Linear 
Regression  of  t  on  t  ,  at  +  $  , 
for  Our  Hypothetical  Examinees, 
for  Each  of  the  Six  Subtests. 


Subtest 

a 

B 

4 

1.00266 

0.00393 

5 

1.01779 

-0.00650 

6 

1.01132 

-0.00030 

7 

1.01634 

-0.00251 

8 

0.99995 

-0.00865 

9 

1.00918 

0.01323 
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1/2 

(5.1)  instead  of  actual  values  of  [I*(t  )]  .  If  the  conditional 

s 

distribution  of  t  ,  given  r  ,  is  approximately  normal,  with 
the  true  ability  t  and  the  reciprocal  of  the  square  root  of  the 
test  information  function  as  the  two  parameters,  then  the  error  score 
e  will  distribute,  approximately,  normally  with  zero  and  unity  as 

O 

its  two  parameters. 

The  frequency  distribution  of  the  500  error  scores  for  each 

of  Subtests  4  through  8,  and  the  498  error  scores  for  Subtest  9, 

was  obtained  using  the  category  width  of  0.2  .  Figure  5-2  presents 

these  results  in  the  form  of  histograms,  together  with  the  standard 

normal  density  function,  which  is  drawn  by  a  dotted  curve  in  each  of 

the  six  graphs.  The  chi-square  test  for  the  goodness  of  fit  was  made 

for  each  histogram  against  the  standard  normal  density  function  by 

combining  all  the  subintervals  below  e  ■  -2.8  into  one  category,  and 

all  sub intervals  above  e  ■  2.8  into  another,  to  give  thirty  categories 

in  total  and  make  the  number  of  degrees  of  freedom  in  each  chi-square 

2 

test  29  .  As  it  turned  out,  for  Subtest  4  we  obtained  x  *  32.812 

2 

which  provides  us  with  0.25  <  p  <  0.50  ;  for  Subtest  5,  x  ■  28.269  , 

0.50  <  p  <  0.75  ;  for  Subtest  6,  x2  "  18.878  ,  0.90  <  p  <  0.95  ; 

2 

for  Subtest  7,  x  ■  32.574  ,  0.25  <  p  <  0.50  ;  for  Subtest  8, 

2  2 
X  ■  33.695  ,  0.25  <  p  <0.50  ;  and  for  Subtest  9,  x  ■  26.166  ,  which 

provides  0.50  <  p  <  0.75  . 
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FIGURE  5-2 

Frequency  Distribution  of  the  Error  Score  e  (Solid  Line)  of  Our 

s 

Hypothetical  Examinees,  in  Comparison  with  the  Standard  Normal 
Density  Function  (Dotted  Curve). 
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VI  Discussion  and  Conclusions 

Following  the  previous  studies  (Samejima,  RR-80-4,  RR-81-2) ,  we 
have  further  investigated  the  effects  of  reducing  the  number  of  test 
items  in  our  Old  Test  on  the  accuracy  of  estimation  of  the  item 
characteristic  functions  of  the  ten  binary  test  items,  using  the  same 
combination  of  a  method  and  an  approach,  i.e.,  Simple  Sum  Procedure  of 
the  Conditional  P.D.F.  Approach  combined  with  the  Normal  Approach  Method. 
As  it  turned  out,  we  were  able  to  successfully  estimate  the  item 
characteristic  functions  with  as  few  as  eleven  test  items  In  our  Old 
Test,  i.e.,  Subtest  6.  This  is  a  substantial  decrease  from  the 
thirty-five  items  of  the  original  Old  Test.  It  appears  that  an 
appropriate  strategy  is  to  select  test  items  for  the  Old  Test  whose 
difficulty  parameters  are  fairly  evenly  spaced  over  the  interval  of 
ability  of  our  interest.  Once  again,  the  method  of  moments  proved 
useful  in  the  present  study. 

When  fewer  than  eleven  test  items  were  used  as  the  Old  Test,  i.e. 
Subtests  7,  8  and  S,  tie  estimation  of  the  operating  characteristics 
was  not  so  successfi  l.  We  may  conclude,  therefore,  the  border  line  is 
between  Subtest  6  and  Subte&c  7  to  separate  those  which  are  acceptable 
as  our  Old  Test  anc  t  hose  wh ich  are  not . 
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